— PRACTICAL  APPLICATION 

CRITIQUING  A RESEARCH  REPORT 

Cheryl  Beck  (1990)  has  developed  a list  of  insightful  questions  that  every  researcher  should  an- 
swer satisfactorily  before  submitting  a final  version  of  a research  report.  Although  she  created  it 
for  students  and  professional  colleagues  in  the  field  of  nursing,  we  have  adapted  her  list  of  ques- 
tions to  apply  to  research  report  writers  in  general.  The  following  checklist  should  not  only  help 
you  evaluate  the  reports  that  you  read  but  can  also  serve  as  a guide  as  you  assess  your  own  writing. 


CHECKLIST 

Criteria  for  critiquing  a 
research  report 


to  use  this  checklist  to  critique 
\t  research  report  and  complete. 

1 Go  to 

http://www.prenhall.com/leedy 


Step  1.  The  Problem  Yes 

Is  the  problem  clearly  and  concisely  stated?  

Is  the  problem  adequately  narrowed  down  into  a researchable 

problem?  

Is  the  problem  significant  enough  to  warrant  a formal  research 

effort?  

Is  the  relationship  between  the  identified  problem  and  previous 

research  clearly  described?  

Step  2.  Literature  Review 

Is  the  literature  review  logically  organized?  

Does  the  review  provide  a critique  of  the  relevant  studies?  

Are  gaps  in  knowledge  about  the  research  problem  identified?  

Are  important  relevant  references  omitted?  

Step  3-  Theoretical  or  Conceptual  Framework 

Is  the  theoretical  framework  easily  linked  with  the  problem,  or  does 

it  seem  forced?  

If  a conceptual  framework  is  used,  are  the  concepts  adequately 

defined,  and  are  the  relationships  among  these  concepts  clearly 
identified?  

Step  4-  Research  Variables 

Are  the  independent  and  dependent  variables  operationally  defined?  

Are  any  confounding  variables  present?  If  so,  are  they  identified?  

Step  5.  Hypotheses 

Are  the  hypotheses  clear,  testable,  and  specific?  

Does  each  hypothesis  describe  a predicted  relationship  between 

two  or  more  variables  included  in  each  hypothesis?  

Do  the  hypotheses  logically  flow  from  the  theoretical  or  conceptual 

framework?  

Step  6.  Sampling 

Is  the  sample  size  adequate?  

Is  the  sample  representative  of  the  defined  population?  

Is  the  method  for  selection  of  the  sample  appropriate?  

Is  there  any  sampling  bias  in  the  chosen  method?  

Are  the  criteria  for  selecting  the  sample  clearly  identified?  


No 


Step  7.  Research  Design 


Is  the  research  design  adequately  described? 

Is  the  design  appropriate  for  the  research  problem? 

Does  the  research  design  address  issues  related  to  the  internal  and 

external  validity  of  the  study? 

Step  8.  Data  Collection  Methods 

Are  the  data  collection  methods  appropriate  for  the  study? 

Are  the  data  collection  instruments  described  adequately? 

Do  the  measurement  tools  have  reasonable  validity  and  reliability? 

Step  9-  Data  Analysis 

Is  the  results  section  clearly  and  logically  organized? 

Is  the  type  of  analysis  appropriate  for  the  level  of  measurement 

for  each  variable? 

Are  the  tables  and  figures  clear  and  understandable? 

Is  the  statistical  test  the  correct  one  for  answering  the  research 

question? 

Step  1 0.  Interpretation  and  Discussion  of  the  Findings 

Does  the  investigator  clearly  distinguish  between  actual  findings 

and  interpretations? 

Are  the  interpretations  based  on  the  data  obtained? 

Are  the  findings  discussed  in  relation  to  previous  research  and  to  the 

conceptual/theoretical  framework? 

Are  unwarranted  generalizations  made  beyond  the  study  sample? 

Are  the  limitations  of  the  results  identified? 

Are  implications  of  the  results  discussed? 

Are  recommendations  for  future  research  identified? 

Are  the  conclusions  justified? 


